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Abstract —We consider the problem of decentralized detection 
where peripheral nodes make noisy observations of a phe¬ 
nomenon and send quantized information about the phenomenon 
towards a fusion center over a sum-rate constrained multiple 
access channel. The fusion center then makes a decision about 
the state of the phenomenon based on the aggregate received 
data. Using the Chernoff information as a performance metric, 
Chamberland and Veeravalli previously studied the structure 
of optimal rate allocation strategies for this scenario under 
the assumption of an unlimited number of sensors. Our key 
contribution is to extend these result to the case where there 
is a constraint on the maximum number of active sensors. In 
particular, we find sufficient conditions under which the uniform 
rate allocation is an optimal strategy, and then numerically verify 
that these conditions are satisfied for some relevant sensor design 
rules under a Gaussian observation model. 

Index Terms —Decentralized detection, wireless sensor net¬ 
works, Chernoff information, multiple access channel. 

I. Introduction 

Decentralized detection is a central problem in wireless 
sensor networks (WSN) m-Bi. In a decentralized detec¬ 
tion problem, spatially separated sensors make private noisy 
observations of the state of a phenomenon and send their 
observations to a fusion center (EC) over rate constrained 
channels for the final decision about the state of the nature. 
This problem has been considered extensively in the literature 
when each sensor has a private communication link to transmit 
its information towards the EC, see III and references therein. 

However, in a wireless sensor network the sensors typically 
share a common multiple access channel (MAC) to the EC. 
In this work we assume that the MAC channel is error-free 
but subject to a common sum-rate constraint of rate R bits 
per channel use. We consider a binary hypothesis testing 
problem under which N sensors make private observations 
of the phenomenon, or hypothesis, H £ % = {Hq,Hi}. 
Conditioned on the true hypothesis H, the observations at the 
sensors are independent and identically distributed (iid). Each 
sensor S'„, for n = 1,..., A^, is required to quantize its own 
observation into an (integer) bit message in such a way that 
the sum-rate constraint 

N 

Y.rn<R ( 1 ) 

n—1 

is satisfied. The EC then uses the aggregate set of the received 
messages to make the final decision H G R. 


Chamberland and Veeravalli El studied this network model 
in terms of the optimal number of sensors N and rate 
allocation r = (ri,...,rjv) using the Chernoff information 
at the input of the EC as a performance metric. They proved 
that if, for a given observation model, there exists a rate-one 
quantization rule for a single sensor which leads to the transfer 
of at least half of the Chernoff information contained in each 
raw observation, then having N — R rate-one sensors is 
optimal. They also proved that such a rate-one sensor decision 
rule exists when the observations at the sensors are equal 
variance Gaussian or Exponentially distributed. 

Although the optimality result of El greatly simplifies the 
network design it may in practice, due to cost and space 
constraints, not always be feasible to have N = R sensors in a 
network. In the present paper we therefore address the problem 
of finding an optimal rate allocation r when the total number 
of sensors N is fixed a priori. Eor simplicity, we assume that 
R = MN, where M in a positive integer. As in El, we use the 
Chernoff information at the input of the EC as the performance 
metric. We will show that if for a given sensor design method, 
the Chernoff information at the output of a single sensor is a 
discrete concave function of the sensor’s rate, then uniform 
rate allocation is an optimal strategy for the network. We will 
also argue and show numerically that existing sensor design 
rules do in fact yield a per sensor Chernoff information that is 
a discrete concave function of the rate. We will finally illustrate 
numerically how this translates into network performance in 
terms of error probability. 

The outline of this paper is as follows. In Section [II] we 
formulate the problem. Then, in Section |III] we present our 
main results and establish the numerical results in Section |IV] 
The paper is concluded in Section |Vl 

II. Preliminaries 

We consider a binary hypothesis testing problem where 
N sensors. Si,..., Sn, are arranged as in Fig. [T] Sensor 
Sn makes at each time t = an observation Xn,t 

about the state of the same phenomenon H, and computes 
a message Un,t for the EC using its decision function 7„. We 
assume that observations are iid over space and time, i.e., Xn,t 
is viewed as independent realizations of a common random 
variable X with conditional probability density function (pdf) 
fx\H{x\Hj), where j = 0,1, over some observation space X. 
The output message Un,t = ln{xn,t) is from an r„-bit message 



Fig. 1. Setting of sensors in a network, where the sensors send their data 
through a MAC channel to the FC. 


set Ur„ = {1, 2,..., 2’’"}, wher^il € Z++ is the allocated 
rate to sensor Sn- The FC makes the final decision in favor of 
a hypothesis based on the aggregated set of sensor messages 
over space and time using its function 70 : U_ ^ TL, i.e., 
7 o {ui.i-.T, ■ ■ •, wat.Iit) = H, where li_ = x ... x UrN 
Un,i:T — {un,i ■ ■ ■, Un,T)- It is Well known that the optimal 
FC rule, in the sense that it minimizes the Bayesian probability 
of error = Pr (jl ^ is given by the maximum a- 
posteriori (MAP) detector, which can be implemented as a 
likelihood ratio test on the aggregate set of sensor messages 
El. Our main focus is on the properties of the optimal rate 
allocation r subject to the sum-rate constraint dB, under the 
assumption of a given sensor design rule for each allocated 
rate and under optimal FC processing. 

The output messages of sensor Sn over time can be viewed 
as realizations of a random variable Un with a conditional 
probability mass function (pmf) given by 

Pu„\H iun\Hj) = Pr : 7„ {xn) = Un\Hj} 

= _ fx\H {x\Hj) dx, 

dxGjn ^(Un) 


where 7“^ (m„) denotes the set of observations x that satisfy 
7ra(a;) = Un- The aggregate set of sensor messages at any 
particular time t may similarly be viewed as a realization of 
a random vector U_ with pmf 

Pu\H = Pui\H{ui\Hj) . . . 

-A f (2) 

= n / fx\H{x\Hj)dx , 


where u = {ui ,..., ujv). Given a decision function 7„ for a 


*We use to denote the set of natural numbers excluding 0, i.e., = 

{1, 2,..and let Z++ = Z+ U {0}. 


sensor Sn of rate r„, let 

Cr„( 7 n,a)= ( 3 ) 

— log ^2 [Pu\H (,Un\Ho)] [Pu\H iUn\Hi)] 

The Chernojf information of sensor Sn is then given by 

{"fn) = max Cr-„ (7n,a) , ( 4 ) 

0<a<l 

and the Chernoff information associated with the complete set 
of sensor decision functions 7 = (71,..., 'y^) i^ 

N 

(T) = max Cr^ (7^, a) . ( 5 ) 

— 0 < q :<1 

n —1 

While optimizing P^ = Pr (^H ^ directly for any 
finite N and T is generally intractable, it can be shown that 
for the optimal FC rule it follows that El 

^ (i) = “ ^ 

The Chernoff information C (7) at the input of the FC may 
thus be viewed as the (exponential) rate of which the proba¬ 
bility of error tends to zero when increasing T for a given rate 
allocation r and set of sensor rules 7, and was for this reason 
chosen as the performance metric in El- In particular, by 
maximizing C (7) over r and 7, Chamberland and Veeravalli 
El found sufficient conditions under which N = R sensors 
each sending a one bit message (i.e., ri = ... = rjv = 1) is 
optimal. Flowever, a key assumption behind their result is that 
the number of sensors N is not fixed a priori. The problem of 
rate allocation for hypothesis testing remains open when the 
maximum number of sensors N is strictly less than the rate of 
the MAC channel R. We address this question of optimal rate 
allocations in this regime when the method by which sensors 
are designed for a given rate is a-prior fixed. 

To this end, we will by a sensor design method refer to an 
algorithm that for any rate r £ generates a unique decision 
function which maps each input from the observation space X 
to an output from a message space Ur = {1, 2 ,..., 2'’}, and 
we will throughout the paper assume that such an algorithm 
exists. Since there given the sensor design method is a one-to- 
one relationship between any rate r and a decision function 7, 
we will from now on also frequently drop the explicit mention 
of 7„ in @ and (| 4 |i. In the following section we will show that 
if, for a given sensor design method, the resulting Chernoff 
information in © of a single sensor, say S'„, is a discrete 
concave function of the rate r„, then uniform rate allocation 
is an optimal rate allocation strategy. 

III. Main Results 

Suppose that there is a sensor design method which for any 
rate r provides a decision rule with Chernoff information Cr, 
cf. ©. We will show if the resulting Chernoff information Cr 

^Note that the particular form of follows due to the assumed indepen¬ 
dence of the sensor messages. 









is a discrete concave function of rate r, an optimal strategy for 
the design of sensors arranged as in Fig. [T] is to have sensors 
with the same rates r„ = M, where M = R/N and M,N 
and R are positive integers. In what follows, we first define 
the concept of a discrete concave function. Then, in Theorem 
1, we state our main result on the optimality of uniform rate 
allocation. 

Definition: We say that g : Z+ —>■ R is a discrete concave 
function over Z'*' if 0 

g{k-l)+g{k + l)< 2 g{k), Vfc G Z++. 


The following lemma follows straightforwardly for any dis¬ 
crete concave function g{k) by iteratively using the definition 
above, and is given without proof. 

Lemma 1 : If g(k) is a discrete concave function of k, then 

9 {ki) +9(^2) < g 

for all ki,k2 G Z+. 


ki + k 2 


ki + k 2 


, ( 7 ) 


Lemma [T] implies that if the Chernoff information Cr is a 
discrete concave function of rate r, the summation of Chernoff 
information of two sensors with rates ri and Vj, is less than the 
summation of the Chernoff information of two sensors with 


rates 


Ti+Ti 


and 


n+Tj 


where 


'n+rf 


G + G 

2 


2 


e{o,i}. 


We will use this lemma for the proof of our main result 
in Theorem [T] Consider the problem of allocating rate to 
N sensors arranged as in Fig. [T] making iid observations 
about the same hypothesis H, and where the MAC channel 
is subjected to a rate constraint in ([T]i, where R = MN for 
some M G Z++. Assume that there is a (common) sensor 
design method which results in the Chernoff information 
for sensor 5 '„ at rate r„. We have the following theorem for 
an optimal rate allocation. 


Theorem 1 : Given a sensor design method, if for a single 
sensor S'„ the resulting Chernoff information Cr„ is a discrete 
concave function of rate r„, a uniform rate allocation across 
sensors is optimal. 

Proof: Consider a network of N sensors with rate al¬ 
location r = (ri,...,riv) and decision functions 7 = 
(71,... ,7Ar). Without loss of generality we can assume that 
ri < ... < TAT. Let Cr„ be a discrete concave function of 
rate r^. Consider replacing sensors Si and Sn, with decision 
functions 71 and 77V, with two sensors S[ and S'pj with rates 
r[ = J decision functions 7^ 

and 7^, where ri < rj < < r^r. According to Lemma [ 1 ] 


Cri + Crjv ^ CrJ + Cr'^ . 

By additionally letting S'^ — Sn, 7^ = 'yn and = r„ 
for n = 2,...,A^— 1 we obtain a new rate allocation r' = 
(rj,..., rjy) and decision functions 7' = (7^,..., 7^) for 


which 


N 




N 


- ■ 

n—1 


The new rate allocation r' also satisfies the rate constraint in 
O since ri -f r^r = r'l + r^. We can repeatedly replace the 
lowest-rate and the highest-rate sensors with minimum dif¬ 
ference sensors without decreasing the Chernoff information, 
until we get uniform-rate sensors, i.e., ^[ = ... = 7^ and 
rj = ... = = M. For the uniform rate allocation it follows 

that 

N 

Y^Cr^SNCM- ( 8 ) 

n—1 

We further have that 

/ V N 

C{j) < y max Cr^{an) 

7 ' ( 9 ) 

n—1 

where (a) and (b) are immediate results of 0 and (| 4 |i, 
respectively, and (c) is obtained using ®. Note however that 
the inequalities in (| 9 ]l are satisfied with equality when all the 
sensors have the same rate = M and consequently the same 
decision function 7 = 71 = ... = 7 Ar, which implies the same 
optimizer a* in (| 4 ]l and 0 , i.e., max^ C (7) = NCm- Cl 

As discussed above, the optimality of uniform rate alloca¬ 
tion in a network of sensors arranged as in Fig.[T]relies on the 
concavity of the Chernoff information of the sensor design 
method. If there is no such a design method, the results of 
this paper are in vain. We will therefore explore this point 
numerically in the next section under the assumption of equal 
variance Gaussian observations. 


IV. Numerical Results 

We shall first consider the design method of Benitz and 
Bucklew 0 for the design of sensor decisions, and numeri¬ 
cally show that the Chernoff information resulting from their 
method is a discrete concave function of rate. Moreover, 
using a numerical optimization method we design sensor 
decision functions with good performance, and show that the 
concavity remains. Finally, using simulations we relate this to 
the error probability performance of different rate allocations 
in a network of sensors. 

We consider the case where each observation Xn,t consists 
of an antipodal signal ±m in an additive unit-variance white 
Gaussian noise Vn. The observation model is 

Hq : Xn = -m + Vn , 

Hi : Xn = +m + Vn . 

The observation space at each sensor is in this case equal to 
the real space, i.e., A = R. 






















Fig. 2. Chemoff information of a single sensor designed using Benitz and 
Bucklew’s method as a function of rate, for different SNRs. 


At high rates, the term o (2 vanishes, and it can be shown 
from hrst principles that 

c;_i+c+i <2c;, 

i.e., the Chernoff information of sensors designed using this 
method is asymptotically a discrete concave function of rate 
7’. Although it is difficult to formally prove concavity for finite 
r, it is straightforward to calculate Cr„ in (IDl for any given 
r and m. Fig. | 2 ] shows the Chernoff information of a sensor 
designed using the method of El as a function of rate, for 
different values of the per channel signal-to-noise ratio (SNR), 
which we define as f = Imp, and provides empirical evidence 
of concavity. The Chernoff information Cr is for any rate r 
upper bounded by the Chernoff information Coo contained in 
the raw observation, which is defined as 

Coo = max - f fx\H{x\Ho)°‘dx. ( 12 ) 

0<a<l Jx 

For Gaussian distributed observations Coo = vn? 12 , which can 
also be obtained from (fTTT) by letting r ^ oo. 


A. Benitz and Bucklew’s Method 


B. Numerical Method 


Benitz and Bucklew jh) proposed a sensor design method 
(or quantization rule) in detection with iid observations, using 
a companding function q : X [ 0 , 1 ]. The idea behind 
the method is to uniformly quantize the range [0,1], and let 
the companding function define the quantization of X. The 
optimal companding function q depends on the conditional 
distributions of the observations, see @ Section V], and the 
key result of El is a set of conditions that identify the 
asymptotically optimal q in terms of Chernoff information in 
the high rate regime where r oo, but the design methods 
have been empirically observed to work well also for finite r. 

For the observation model in cni it can, following the 
general derivation of El, be shown that the asymptotically 
optimal companding function q is given by 


7(x) = S (^) . 

where Q{y) is the unit-variance Gaussian cumulative distribu¬ 
tion function given by 


Q{y) = 



i _, 

,— e 2 di _ 


This result holds, somewhat surprisingly, independently of the 
specihc value of m. By the monotonicity of q{x) it follows 
that the obtained quantizer of A = K is a monotone quantizer 
171 with partitions Ii = [—oo,5i),l2 = [6i, 62),... = 

[6if_i,oo] for K = 2 '', with boundaries given by bi = 
(i/K) for i = 1 ,..., K — 1 . The resulting Chernoff 
information of a rate-r sensor becomes Cr = C* + o( 2 “^’’) 
where El 


tn 

Cr = — - log 


1 + 




( 11 ) 


In order to provide a contrast to the previous section, 
we also consider a quantizer obtained through a numerical 
optimization. For a rate-r quantizer, we form a partition of 
the real interval into K = 2 ^ intervals Ii,..., Ix with 
randoml }3 generated boundaries {61,..., bx-i}- Assume that 
bo = —00 < bi < ... < bx-i < bx — +00. We then 
iteratively update the boundaries and the value of a in Q 
in such a way that C'r„(7n,a) is maximized at each step. A 
full iteration consists of updating the boundaries and updating 
the value of a. In each iteration, the values of each bi - 
from bi to bx-i - are first updated sequentially while the 
other boundaries and a are kept fixed. The value of a is then 
updated while the boundaries are kept fixed. The position of a 
boundary, say bi, is modified in the interval [bi-i,bi+i] to (nu¬ 
merically) maximize Cr„ {'jn, ct), and the value of a is selected 
to (numerically) maximize Cr^{'jn,ct) over a G [ 0 , 1 ]. The 
iterations are continued until the improvement in Cr„{'yn,ct) 
is less than r] = 10“^. 

Fig. | 3 ] illustrates the Chernoff information contained in an 
observation [cf. (fTTT il. the Chernoff information of a sensor 
designed using the numerical method described above, and the 
Chernoff information of a sensor designed using the method 
proposed in j^, when m = 1 {or £ — 0 dB). The numerical 
method always results in a* = 0.5 for any rate r, which is 
implicitly used also in (fTTl l given the optimality a = 0.5 in 
(HI. Two things can be observed in Fig. [ 3 ] The resulting 
Chernoff information of the numerically designed sensors is 
discrete concave; and the difference to the asymptotic method 
of Benitz and Bucklew is marginal. We could naturally also 
initialize the numerical optimization with the result of El, but 
the difference by doing so is, again, marginal. 

^Boundaries are drawn uniformly in the range [— m —5, m + 5 ] and sorted. 

















Fig. 3. Chemoff information of a single sensor designed using Benitz 
and Bucklew’s method and using the numerical method, and the Chernoff 
information contained in each observation, for f = 0 dB. 


C. The Error Probability Performance of Sensor Networks 

Finally, in order to illustrate the usefulness of the obtained 
results for a finite T, we consider the probability of error 
of a network of sensors designed using the numerical design 
method described in the previous section, for the case of a 
single shot observation, i.e., T = 1 . We explicitly consider 
a network of = 6 sensors arranged as in Fig. [T] with the 
same observation model as before, and study the effect of 
different rate allocations r = (ri,..., r^v) subject to the rate 
constraint in O with i? = 12 bits. The decision functions are 
redesigned for each SNR value E = It is worth noting 
that as the numerical method yields a* = 0.5 for all rates r, the 
inequalities in @ will still be tight meaning that the Chernoff 
information of the whole network is in this case given by 
the sum of the Chernoff information of the individual sensors, 
although this can not be assumed in general for networks with 
non-uniform rate allocations. 

The probability of error of the MAP FC rule can 

for a given set of decision functions, and under the assumption 
of equally likely hypotheses, be obtained as (cf. 

{PmH , 

u 

which can be straightforwardly computed numerically for the 
examples at hand using the Gaussian Q-function and the 
obtained quantization thresholds, without the need for Monte- 
Carlo simulations. 

The resulting probability of error for different rate allo¬ 
cations are illustrated in Fig. | 4 ] It can be observed that the 
uniform rate allocation outperforms all the other rate allocation 
schemes in terms of the error probability performance, which 
is consistent with the results obtained by studying the Chernoff 
information. 



Fig. 4. En'or probability performance of a sensor network for different rate 
allocation schemes. 


V. Conclusion 

We have in this paper obtained a sufficient condition for the 
optimality of uniform rate allocations for sum-rate constrained 
decentralized detection in wireless sensor networks, and then 
numerically verihed that this condition holds true for some 
example sensor design methods. Although it is in general hard 
to stringently prove the required concavity property, we have 
in m obtained simplified sufficient condition for the discrete 
concavity of the Bhattacharyya distance, obtained from Q 
with a = 0 . 5 , completed the stringent proof under a Laplacian 
observation model and under the Gaussian model given the 
truth of a conjecture regarding the Gaussian Q-function. 
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